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Claims 

1 . (Currently Amended) A method for differentiating between foreground 
objects and background objects within a scene being captured through an image capture 
device, comprising: 

emitting a ray of light from a light source toward an object of the scene; 

opening an aperture cover allowing access to a sensor of the image capture device 
for reflected light from the light source; 

closing the aperture cover after a set time, the predefined amount of time 
corresponding to a maximum distance traveled by the light; 

generating a depth mask identifying objects within a foreground region and a 
background region of the scene based upon the light captured during the set time, the 
depth mask identifying objects within the foreground region with a first bit value and 
identifying objects within the background region with a second bit value; and 

adjusting image capture device parameters an image capture device parameter 
according to bit values of the depth mask for one or more of a sequence of captured 
image frames of the scene, wherein the image capture device parameters are parameter is 
selected from one of focus, brightness, exposure or gain , and the adjusting of the image 
capture device parameters being done independently in the foreground from the 
background ; and 

applying the adjusted image capture device parameter so that the brightness, 
exposure, or gain of the captured image frames is adjustable independently for both of the 
objects within the foreground region and the objects within the background region . 

Amendment 2 Atty. Docket No. SONYP03 1 



Application No. 10/758,817 

Office action response dated April 14, 2009 

Responsive to Office Action Dated January 14, 2009 

2. (Original) The method of claim 1, further comprising: 
storing the depth mask in memory of the image capture device. 

3. (Original) The method of claim 1, wherein the light source is configured 
to emit infrared light. 

4. (Original) The method of claim 1, wherein the method operation of 
opening an aperture cover allowing access to a sensor of the image capture device 
includes, 

receiving reflected light from the objects within the foreground region. 

5. (Canceled). 

6. (Previously Presented) The method of claim 1, wherein the method 
operation of adjusting image capture device parameters according to bit values of the 
depth mask includes, 

determining an optimal amount of light based upon the depth mask; and 
adjusting the aperture cover to allow the optimal amount of light into the image 
capture device. 

7. (Previously presented) The method of claim 1, wherein the image capture 
device parameters are adjusted through mechanical adjustments. 
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8. (Original) The method operation of claim 1, wherein the method operation 
of emitting a ray of light from a light source toward an object of the scene includes, 

pulsing infrared light from the light source. 

9. (Currently Amended) A method for adjusting image capture settings for a 
single an image capture device, comprising: 

identifying a scene; 

capturing an image of the scene through the single image capture device; 
generating a depth mask of the scene from data defining the image of the scene; 

and 

adjusting pixel values of the data defining the image corresponding to objects 
within any one or both of a foreground region and a background region of the captured 
image, wherein adjusting pixel values associated with the foreground region are 
independent of adjusting of pixel values associated with the background region, and the 
adjusting of pixel values is according to bit values of the depth mask , wherein the 
adjusting pixel values causes a change in brightness such that both of the pixel values 
associated with the foreground region and pixel values associated with the background 
region are adjustable independently for brightness . 

10. (Original) The method of claim 9, wherein the method operation of 
generating a depth mask of the scene from data defining the image of the scene includes, 

segmenting the foreground and background regions of the scene. 
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1 1 . (Original) The method of claim 9, wherein the data defining the image of 
the scene includes pixel data where each pixel is tagged with distance information. 

12. (Canceled). 

13. (Original) The method of claim 9, wherein the image capture device is 
selected from the group consisting of a digital camera, a web cam, and a camcorder. 

14. (Original) The method of claim 9, further comprising: 
displaying a portion of the image of the scene having adjusted pixel values. 

15. (Original) The method of claim 14, wherein the portion of the image of the 
scene is an image of a participant for use in an interactive gaming application. 

16. (Canceled). 

17. (Currently Amended) An image capture device configured to provide an 
image of a scene, comprising: 

depth logic configured to provide a depth mask associated with the scene, the 
depth mask configured to distinguish between foreground objects and background objects 
within the scene; and 

image capture logic configured to adjust an image capture device setting for a 
characteristic associated with the image based upon a corresponding bit value of the 
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depth mask, wherein the bit value determines whether the respective pixel is associated 
with one of the foreground objects and the background objects, and the image capture 
logic is configured for adjustments to a selected characteristic for foreground objects 
independently of adjustments to a selected characteristic for background objects of the 
image data of the scene to apply the adjusted image capture device setting so that the 
pixels of the image associated with both of the foreground objects and the background 
objects are adjustable independently for the characteristic , and 

wherein the characteristic is selected from a group consisting of focus, exposure, 
gain, and brightness. 

18. (Original) The image capture device of claim 17, wherein the depth mask 
is a bit mask having a first logical value assigned to represent the foreground objects and 
a second logical value assigned to represent the background objects. 

19. (Original) The image capture device of claim 17, further comprising: 

a sensor in communication with the depth logic, the sensor configured to receive a 
light signal reflected from one of the foreground objects, the receipt of the light signal 
indicating a location corresponding to one of the foreground objects. 

20. (Original) The image capture device of claim 17, wherein each logic 
element is one or a combination of hardware and software. 
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21. (Original) The image capture device of claim 17, wherein the image 
capture device is a video capture device. 

22. (Original) The image capture device of claim 21, wherein the depth logic 
is further configured to periodically provide a depth mask for a sequence of video frames 
captured by the video capture device. 

23. (Previously presented) The image capture device of claim 17, wherein the 
image capture device setting is adjusted through one of a mechanical or electrical 
adjustment. 

24. (Original) The image capture device of claim 17, wherein the image 
capture logic is further configured to adjust each pixel of image data of the scene. 

25. (Currently Amended) A system, comprising: 
a computing device; 

a display screen in communication with the computing device, the display screen 
configured to display an image of a scene; 

a video capture device in communication with the computing device, the video 
capture device providing scene image data to the computing device for presentation on 
the display screen, the video capture device including, 
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depth logic configured to provide a depth mask associated with the scene, the 
depth mask configured to distinguish between foreground objects and background objects 
within the scene; and 

image capture logic configured to adjust an image capture device setting for a 
characteristic associated with each pixel of the image data based upon depth information^ 
the adjustment of each pixel being independent of adjustment to another pixel, whether 
associated with foreground objects or background objects, ; and 

image capture logic configured to apply the adjusted image capture device setting 
so that each pixel of the image is adjustable independently of another pixel for the 
characteristic, whether associated with the foreground objects or the background objects, 
and wherein the characteristic is selected from the group consisting of focus, exposure, 
gain, and brightness. 

26. (Original) The system of claim 25, wherein the computing device is a 
game console. 

27. (Original) The system of claim 25, wherein the depth logic is further 
configured to periodically provide a single depth mask for a sequence of video frames 
captured by the video capture device. 

28. (Previously Presented) The system of claim 25, wherein the image capture 
device setting is adjusted through one of a mechanical or electrical adjustment. 
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29. (Original) The system of claim 25, wherein the video capture device is a 
webcam. 

30. (Original) The system of claim 25, wherein the image data defines data for 
each pixel, the data for each pixel including distance information. 

31. (Original) The system of claim 26, wherein the scene image data includes 
an image of a person, the image of the person being incorporated into a video game for 
interaction therein. 

32. (Original) The system of claim 25, wherein the depth information is 
obtained from a depth mask, the depth mask defining a relative distance between an 
object associated with the corresponding pixel and the video capture device. 

33. (New) The method of claim 1, further comprising, 

adjusting a focus parameter of the image capture device according to the bit 
values of the depth mask, so that the objects within the foreground region are in focus. 

34. (New) The method of claim 1, wherein the adjusted captured image 
frames facilitates tracking of the objects within the foreground region by reducing 
brightness of the background region. 
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35. (New) The method of claim 9, wherein the adjusting of pixel values 
facilitates tracking of the objects within the foreground region by reducing brightness of 
the background region. 

36. (New) The method of claim 17, further comprising, 

image capture logic configured to adjust an image capture device setting for focus 
based upon a corresponding bit value of the depth mask, so that the foreground objects 
are in focus. 

37. (New) The method of claim 17, wherein the adjusted pixels of the image 
facilitates tracking of the foreground objects by reducing brightness of the background 
objects. 

38. (New) The system of claim 25, further comprising, 

image capture logic configured to adjust an image capture device setting for focus 
based upon depth information, so that the foreground objects are in focus. 

39. (New) The system of claim 25, wherein adjusted pixels of the image 
facilitates tracking of the foreground objects by reducing brightness of the background 
objects. 

40. (New) The method of claim 9, wherein the foreground and background 
regions define two layers of the scene; 
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wherein the scene includes additional layers; and 

wherein the method operation of adjusting pixel values is performed for data 
defining the image corresponding to objects within any one of the layers of the scene. 
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